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INTRODUCTION 



People who work together to develop and coordinate services for 
handicapped and at-risk children face a variety of responsibilities. Among 
the most challenging of these responsibilities, for both state and local 
personnel, is evaluating interagency coor<^ ination activities; specifically, 
evaluating hov interagency coordination develops and how interagency 
coordination affects comprehensive service delivery systems for young 
handicapped children and their families. This monograph, developed by the 
State Technical Assistance Resource Team (START), is intended to help state 
and local agencies conceptualize process evaluations of their interagency 
efforts. This paper is not a procedural handbook, rather, it provides an 
ci^erview of methods and instruments that may be used to review, analyze, and 
document interagency processes. HCEEP state plan grant coordinators and those 
responsible for evaluating or facilitating interagency coordination efforts at 
state and local levels will benefit most from this document, as well as other 
health, administrative, and special education personnel involved with 
interagency efforts. 

Process and Outcome; Two Kinds of Evaluation Studies 

Before an evaluation can be developed, decision-makers involved in 
interagency efforts must determine what kind of evaluation information they 
want. Specifying the type of information needed will help determine whether 
an outcome evaluation, -y process evaluation, or both, should be conducted. 

An outcome evaluation focuses on the end results of various programs or 
products developed by the interagency effort under study (Patton, 1983). A 
revif.w of the literature on interagency coordination indicates that outcome 
evaluation studies and the methodology for such studies are scarce (Morrisey, 
Hall, & Lindsay, 1982). Nevertheless, a need does exist for ways to assess 
the outcomes of interagency coordination and the effects of interagency 
coordination on comprehensive service delivery systems. As such, outcome 
evaluations of interagency coordination might focus on either of two areaf of 
concern. One area looks at specific components of the comprehensive service 
delivery system as outcomes of interagency efforts. This type of outcome 
evaluation would address such questions as: 



• Have conflicting policies across agencies been successfully 
reconciled? 

• Are eligibility requirements consistent across agencies? 

• Have agencies participating in coordination efforts mutually agreed 
upon their respective responsibilities and roles? 

The other type of outcome evaluation is more client focused. It assesses 
the effectiveness of the comprehensive service delivery system and examines 
such areas of concern as: 

• Were all of the children and families who needed services actually 
ident i f ied? 

• Did they receive the necessary services? 

• To whac extent have the children and families identified as needing 
services received appropriate individual program plans? 

• Are they actually making progress as a result of the plans? 

Evaluation studies that examine these kinds of outcomes will provide 
important information about a corrprehens i ve service delivery system — at 
local and at state levels.* 

Process evaluation, on the other hand, is "aimed at elucidating and 
understanding the internal dynamics of program operations .... (It) 
implies an emphasis on looking at how a product or outcome is produced rather 
than looking at the product itself" (Patton, 1980, p. 60). Process 
evaluations are particularly usefjl for looking at areas for program 
improvement as well as identifying areas of exis::ing strength. They allow the 
evaluator to identifv the critical elements that contribute to program success 
or failure (Patton, 1980). 

In a process evaluation, interagency coordination is approached as an 
ongoing activity rather than a specific product or set of products. Process 
evaluation does not focus on whether interagency coordination goals are 
achieved. Rather, it examines the route along which an interagency group 
travels, since the route itself may affect the group's successes or 
failures. Process evaluation rests on the assumption that interagency 
coordination is accomplished in different ways by different groups; thus, 
interagency cociaination is not an end, but a means. 



*Editor*s Note: START intends to address specific questions linked to 
outcomes and effectiveness of interagency coordination in a future monograph. 
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Why process evaluation was chosen 



The reader should note that process evaluation, rather than outcome 
evaluation, is the focus of this paper. We have chosen to emphasize process 
evaluation because most HCEEP state plan grant personnel (our primary target 
audience for this monograph) are in the process of developing their unique 
approach to interagency coordination. Process evaluation, with its focus on 
ongoing activities, can provide feedback which can be used to refine or modify 
the approaches used to develop an effective interagency structure. 

How this paper is organized 

This paper is organized into two sections. The first discusses several 
issues relevant to conceptualizing a process evaluation of interagency 
coordination. The second describes selected process evaluation methods and 
instrum mts . In addition, examples of evaluation instruments and summaries of 
state and local evaluation studies of interagency coordination are appended. 
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Interagency coordination has a long history; in the United States, 
interagency efforts can be traced as far back as the late 1800s. In recent 
years, interagency coordination has received increased attention at local, 
statev and .xational levels. Local service providers, frustrated with existing 
service delivery systems, have set up conmiunity-based interagency groups to 
help clients receive appropriate services. The increased emphasis on 
interagency coordination has also affected state-level organizations. Many 
states have atteript'id to reduce duplication and inefficiency and increase 
quality of services through agency and department reorganizations. At the 
national level there have been numerous initiatives, many stemming from a 1971 
memorandum on interagency coordination from Elliot Richardson, then Secretary 
of Health, Education, and Welfare. 

But despite the recent emphasis on interagency coordination, only limited 
documentation is available on how this coordination directly affects service 
delivery. Compounding this problem is the scarcity of evaluation studies in 
this area. Briefly, some of the reasons for the lack of interagency 
evaluations are: 
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• Interagency coordination is a philosophy akin to "motherhood and 
apple pie,*' An idea with immense face value, litlle objection is 
raised to interagency coordination. In fact, many have advocated 
"coordination reforms in the face of consistently discouraging 
evidence . . . ." (Weiss, 1981, p. 21). 

• Serious methodological problems are associated with attempts to 
research and evaluate interagency coordination. Sound research and 
evaluation methodologies are incomplete (Morrisey, Hall, & Lindsay, 
1982) , and no standard analytical framework is available (Martin, 
Chackeriaki, Imershein, & Frumkin, 1 983) . Further, exi sting 
conceptual tools are inadequate for dealing with the complex 
questions that accompany evaluation efforts in interagency 
coordination. 

• With no framework or guidelines available, jome researchers believe 
that, consequently, every aspect of the interagency group and ics 
environment must be evaluated to achieve adequate assessment 
(Frumkin, Imershein, Chackerian, & Martin, 1983). This approach 
often makes the evaluation ridiculously expensive. 

The evaluation challenges that interagency coordination represents are 

further complicated by the very nature of the interagency effort. Interagency 

coordination has many dimensions and may be defined in many ways. Recognizing 

and understanding the complex, multidimensional nature of interagency 

coordination can make the evaluation challenge more mrnageable. To help 

accomplish this, we have highlighted four interagency issues of significance 

to evaluation efforts: 

(1) Interagency coordination has varied and conflicting definitions. 

(2) Agencies involved in interagency coordination may have different 
purposes for their involvement. 

(3) Interagency coordination follows many patterns; i.e., interagency 
process has varied configurations. 

(4) Interagency coordination is a dynamic, interactional process. 
Each of these issues is discussed below. 

Definitions of Interagency Coordinatio n 

No single, generally accepted definition exists for interagency 
coordination (Gage, 1976), a fact that is in large part due to its 
multidimensional nature. Obviously, the difficulty of L^easuring or evaluating 
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a process such as interagency coordination increases significantly when no 
clear definitions are available. Early attempts to define interagency 
coordination neglected the complexity of Lhe concept (Pelosi & Wiegerink, 
1981). Cans and Horton (1975) defined .c as a "linking together by various 
means the services of two or more service providers to allow treatment of an 
individual's or family's needs in a more coordinated and comf hensive manner 
(p. 32)." 

HEW Secretary Elliot Richardson (IS71) characterized interagency 
coordination as a way to organize service delivery for people at the local 
level (Agranoff & Pattakos, 1979). On the other hand, HEW Undersecretary 
Frank Carlucci (1974) emphasized interagency coordination as a way to achieve 
more efficient management and cost effectiveness in the service delivery 
system by eliminating duplication, fragmentation, and gaps in the system 
(P'^losi, et al, 1981). 

Redburn (1977) elaborated on the distinction between "administrative 
integrations—coordination of agencies at the administrative level—and 
coordination at the ditect service level. He noted that evidence does not 
clearly support the assumption that direct service delivery will automatically 
result from administrative reorganization. The definition offered by Agranoff 
(1977) perhaps most clearly describes interagency coordination's 
multidimensional nature. In his approach to interagency coordination, 
Agranoff (1977) identified four separate dimensions. He suggests that 
interagency coordination be considered at each of these four distinct levels: 

(1) as an approach to services delivery systems; 

(2) as ^n attempt to develop community-level linkages between independent 
agencies; 

(3) as an attempt to reorganize large human services delivery 
bureaucrac ies ; and /or 
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(4) as a govirnmental attempt to develop and manage more coherent public 
policies. 

Martin, Chackerian, Itnershein, and Frumkin (1983) described four similar 
levels of interagency coordination: service delivery, client, administrative, 
and legislative and policy making. Differentiating between these levels of 
interagency coordination emphasizes the differences between state and local 
roles and responsibilities in coordination efforts. Often, local coordination 
tends to be client- and service-related, while state interagency coordination 
tends to be policy or administratively oriented. However, the relationships 
among state and local interagency efforts can facilitate, as well as hinder, 
effective coordination at ei'zher level. 

One of the first distinctions that an evaluation plann^ir must consider in 
designing a pjrocess evaluation for I'nteragency coordination is how tht 
coordination effort is defined. For example, it the coordination aiu^ed at 
integrating the administrative structures of two or more state or local 
agencies, or is it aimed at reorganizing service delivery processes at a 
community level? The way in which each member of an interagency group defines 
interagency Lcordini^tion will largely determine the aget^-y's expectations for 
its role in the coordination effort and its expectations for the outcomes of 
the effort. Ex;»mining the congru^^nce of interagency group members' 
definitions of "coordination," and understanding each agency *s purpose for 
coordination will lay the ground work for a process evaluation. 

Pu^ ^.>oses of Interagency Coordination 

Agencies join coordination efforts for many reasons, some of which are 
not alwa'S immediately apparent. The purposes behind interagency 
coordination, as described in the literature, are varied. 
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• Laws exist at state, local, and national levels that require 
interagency coordination (May & Meyer, 1980; Woodard, Cooper, & 
Trohanis, 1982; Christensen, 1984; Rotberg, Forness, Lynch, Gardner, 
Urbano, & Ejnder, 1982). 

• Monetary incentives attract agency personnel who believe they can 
achieve greater cost effectiveness by combining manpower and other 
resources (Morrill, 1976). 

• Communication with agencies that already belong to an interagency 
group often draws outside agencies to the group (Perry, 1978). 

• A chance to gain access to more and better resources attracts 
agencies, especially those whose own resources are limited (Levine 
and White, 1961) . 

• Agencies loin together as their interests in specific problem areas 
converge (Aram & Stratton, 1974). 

• Philosophical considerations prompt some groups to joing interagency 
efforts; for example agencies may be frustrated with existing systems 
(Agranoff, 1977) or agencies believe interagency coordination can 
help create a better wo-. Id for those receiving special services 
(Weiss, 1981). 

• "Turf protection" is important for some agencies, w^o join ar 
interagency group so they will have input into any decisions that may 
affect them (Flynn, 1984). 

• Public relations benefits pull some agencies to coordination efforts; 
these groups use interagency coordination, in part, to advertise the 
benefits of their particular program (Flyan, 1984). 

Because there are diverse reasons for ai:y agency to become involved in an 

interagency coordination effort, an 3 and critical variable for a 

process evaluation is each agency's .jion of whe purpose for their 

involvement. The e . "ectiveness and dynamics of the group will be seriously 

affected by what each participant is expecwing to accomplish from 

participation in the interagency effort. 



Patterns of Interagency Coordination 

A further clarification and specification of what an interagency 
coordination effort is trying to accomplish can be provided by examining of 
the specific patterns of relationships, or linkages, among participating 
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agencies. The patterns of these relationships, or linkages, represent a 
simplified way of characterizing the exchange relationships that facilitate 
the coordination of two or more agencies (Pattakos & Smith, 1982). A broad 
range of types of linkage structures exist, including: information sharing, 
joint planning and programming, joint use of staff, purchase of services, 
consolidated personnel administration, cross -agency assignment, joint record 
keeping, joint outreach, and joint evaluation (Agranoff & Pattakos, 1979). 

The types of linkage patterns that will be created or modified by an 
interagency coo. lination effort will depend upon the level of coordination 
attempted (service delivery, state or local administration, or policy) and the 
specific purposes for the coordination. Thus, each coordination effort will 
be striving for a unique configuration of linkages among agencies; the 
configuration reflects the context and goals of the group. For this reason, 
examining changes in linkage patterns among agencies is one of the essential 
components of a process evaluation. Such data will describe how interagency 
relationships evolve and will document progress toward goals that involve 
changes in linkage patterns. 

Interagency Coordination as a Dynamic r""o c ess 

The final issue, and one of the most challenging issues faced by those 
involved in an evaluation of interagency coordination efforts, is the dynamic, 
interactional quality of the coordination process. When a group of people 
assemble to accomplish specific tasks, their success is often affected by how 
well individual personalities in the group mesh and by the dynamics of the 
group interactions and processes. A large body of literature has evolved on 
the subject of successful group processes. Most authors agree that an 
effective group usually clearly defines its goals, demonstrates effective 
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leadership, and uses decision-making processes to create results (e.g., Stech 
& Ratliffe, 1979). Furrhei. a healthy, dynamic interagency team has been 
shown to exhibit certain characteristics. Among these are: a relaxed and 
informal atmosphere, an ability lo handle coi.flict, and open expression by all 
group members (e.g., Bradford, 1974). This sort cf group is able to gather 
relevant information and data, make informed choices and decisions, and remain 
committed to their decisions. 

The difficulties of measuring these dynamic processes may seem 
insurmountable. However, if unresolved, they can create problems in group 
processing that are serious barriers to group effectiveness. A comprehensive 
process evaluation can examine decision-making and communication processes to 
pinpoint areas for improvement in group interactions. 

Summary 

As we have seen, interagency coordination, no simple task to begin with, 
is further complicated by a variety of Issues. Obviously, these issues carry 
certain implications for any evaluation effort attempted. In particular, 
persons conducting a process evaluation of interagency activities must not 
lose sight of the complex, multidimensional nature of coordination. Process 
evaluation efforts, to achieve meaningful results, must be structured to: 

(1) measure progresc along several dimensions of interagency coordination 
by examining several variables or sets of variables; 

(2) assess state- and local-level coordination activitie? and the 
relationship between them vis-a-vis the entire interagency structure; 
and 

(3) accounr for the dynamic nature of Khe coordination process by 
identifying a baseline, then studying changes in the selected 
variables over time. 
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In Section II, a discussion of process evaluation methodology is presented to 
assist HCEEP state plan grant staff and related agencies in conducting and 
managing successful evaluation efforts. 
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Successful functioning of an interagency group depends upon the smooth 
interplay of many variables. The Section I discussion of interagency 
coordination issues was intended to highlight for readers some of the more 
Important variables that might be included in a process evaluation. This 
section describes examples of methods which have been developed to examine 
these types of variables. Discussions will focus on measuring precursors for 
success; measuring Lelationships and linkages among agencies; measuring 
dynamic processes in interagency coordination; and examining state-community 
relationships . 

Measuring Precursors to Successful Interagency Coordination 

A particularly helpful structure for looking at some of the variables 
important to include in a process evaluation has been provided by Whetten 
(1981). In light of two general types of purposes for coordination, voluntary 
vs. mandated, Whetten suggests eight factors which pave the way to successful 
coordination efforts. These include (as shown in Table 1): 
• For voluntary coordination: 
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Important variables that might be included in a process evaluation. This 
section describes examples of methods which have been developed to examine 
these types of variables. Discussions will focus on measuring precursors for 
success; measuring L-elationships and linkages among agencies; measuring 
dynamic processes in interagency coordination; and examining state-community 
relationships. 

Measuring Precursors to Successful Interagency Coordination 

A particularly helpful structure for looking at some of the variables 
important to include in a process evaluation has been provided by Whetten 
(1981). In light of two general types of purposes for coordinatior, voluntary 
vs. mandated, Whetten suggests eight factors which pave the way to successful 
coordination efforts. These include (as shown in Table 1): 
• For voluntary coordination: 



a positive attitude toward coordination 

a recognized need for coordination 

awareness of potential coordination pirtners 

assessment of compatibility and desirability 

the capacity .o maintain rhe coordination process 
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Table 1 



Precursors to Successful Coordination 



Voluntary CoordinatiOf 



1 Positive Aliitude 
To^arJ^ Coordinaiion 



2 Recognised Need For 
CoordindiiOn 



3 Av^arene&s of Potential 
Coordin<ilion Partners 



4 Assessment of Compatibility 
and Desirability 



5 Capacity for Maintaining 
Coordination Process 



Cosmopolitan ethos 

Strong professicnal 
background and values 

Organization policies 
and rewards provide 
positive reinforcement 



a interdependence 

b Broa'J goals 

c Diverse clients 

d Wide range of services 



a Informal contact 

b 'Geographic prommily 

' ormal communication 



a Status congrulty 

b Compatible ideology and 
definition of problems 

c Domain consensus 

d Complementary organl2a 
lionai struclures and 
procedures 



a Adequate resources arid 
staff 

b Adequate communication 
channels 

c Flexible rutas !«nd 
procedures 

d Professional staff 



Mandated Coordination 



1 Awareness ol Mandate 
a Understanding of mandate 
b Know.«.O^c of >r,itirauiMi^ organisations 



Assessment of Compatibility and 
Oesirabihty 

a Status congrulty 

b Compatible ideology and deliniiion 
of problems 

c Domain consensus 

d Complementary organizational structuies 
and procedures 

a Goal compatibility 



3 Capacity for Maintaining 
Coordination Process 

a Adequate resources and staff 

b Adequate communication channels 

c Flexible ruler and procedures 

d Professional staff 



Source David A Whetten. "Interorganizattonai Reidiions A Review of tlie Field/' Journal of HH|her Education S2 (September 1961). p 15 
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• For mandated coordination 

1) an awareness of the mandate 

2) assessment of compatibility and desirability 

3) the capacity to maintain the coordination process 

In developing a process evaluation plan, examining some or all of these 
precursors may give a group insight into its "readiness" for working together. 

For ease of discussion, Whetten's eight factors can be grouped into three 
areas, I) situational characteristics, which subsume the variables related to 
"awareness of coordination partners" and "assessment of compatibility and 
desirability;" 2) basis fcr effort, which includes considerations related to 
"attitude towards coordination'' and "recognized need for coordination;" and 3) 
resource sharing, which reflects the variables related to the "capacity to 
maintain the coordination process." Examples of useful methods for examining 
each of these areas are discussed below. 

Situational Characteristics . Measures of situational characteristics 
focus on factors such as awareness, domain similarity and consensus, and 
geographic proximity. Awareness deals with the extent to which each 
interagency team menber is familiar with the services and goals of the other 
agencies. Domain similarity is the extent to which agencies obtain their 
funds from the same sources, share similar goals, employ staff with similar 
professional backgrounds and skills, and provide similar services. Domain 
similarity also refers to compatibility of goals and philosophy of agencies 
involved in the coordinati'>n effort. While domain similarity nay facilitate 
the formation of relationships among agencies, it may also foster competition 
and attempts by some agencies to protect their perceived "turfe." 

Domain consensus refers to the extent of agreement between agencies about 
the problems and needs in the service delivery system and the role of each 
agency involved in the network of services. Researchers agree that the level 
of domain consensus affects the quality of interagency relationships (Schmidt 
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& Kochan, ]977 and Hall et al,, 1977). The Interunit Relationship Scale 
(Bronheira, Cohen, &r ilagrab, 1985) includes measures of awareness, domain 
similarity, and domain consensus. (See Appendix A.) 

Basis for Effort. As discussed earlier, the purposes of a coordination 
effort can vary tremendously and may range from mandatory collaboration to an 
interest in increased access to tesources or more efficient services. Often, 
the distinctions among these purposes are not consistent across members of an 
interagency group. In addition to examining the congruence of purpose among 
group agencies, several relatea factors which further describe the basis for 
coordination can be explored. Among these are the values and attitudes of the 
agencies towards the effort and its goals, the reinforcement structures within 
the agencies for coordination efforts, the perceived needs of agencies for 
coordination, and the level and natare of existing interagency interactions. 
Morrissey, Ht:ll, and Lindsey (1982) offer suggestions for measurement of many 
of these types oi factors. They revj 3w and describe instruments they have 
categorized into four areas: voluntary vs. irandated interactions (measures 
which tap agencies' perceptions of reasons relationships exist between 
organizations), ad hoc vs. formalized interactions (measures which assess the 
degree to which the roles of agencies within a group are clearly prescribed 
and formalized), bargaining or exchange interactions (measures which describe 
the nature of negotiation in interagency relationships), and interpersonal 
ties (measures which clarify the nature of personal relationships among 
personnel in different agencies). 

Resource Sharing . These characteristics reflect *:he ways in which 
agencies participating in the coordination effort exchange information, money, 
clients, referrals, consultation, technical assistance, "power," and other 
resources. Van de Ven & Ferry (1980) have designed a survey focused on how 
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agencies depend upon each other for resources that will help them reach their 
respective goals. The Organization Assessment Instrument (Van de Ven S Ferry, 
1980) can be used by an organization to measure its relationships with other 
agencies. An extensive, well-validated, and reliable instrument, it provides 
information about the degree, type, and quality of communication among 
agencies; the extent to which agencies share a power base; the way resources 
flow (or are shared) among agencies; and the competition for these resources^ 

To help state and local interagency groups obtain a baseline picture 
across all three areas of precursors described above, Bronheim, Cohen, & 
Magrab (1985) developed an instrument based largely on the earlier work of 
Cohen (1984) and Van de Ven & Ferry (1980), This instrument, the Interunit 
Relationship Scale (see Appendix A), is used to gather information that 
focuses on domain similarity, task specialization, interdependence, 
leadership, central control, formalization of relationships, interunit 
communication and interaction; interunit competition, resource flow, interunit 
awareness and consensus, and perceived value of relationships. This scale is 
useful for documenting baseline characteristics and for measuring changes in 
the coordination processes. Since changes in a service delivery system are 
often the desired end result for interagency coordination efforts, it is 
important to understand the ways in which service domains, administrative 
requirements, flow of resources, and philosophical/policy statements may 
change. 
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Measuring Relationships and Linkages Between Agencies 

States and communities, once they have established their interagency 
goals, usually develop plans that change ttieir linkage patterns, or the ways 
agencies interact with one another. For example, some communities may find it 
beneficial for their health and education agencies to develop increased 
interactions: — from simple information sharing to joint use of staff and joint 
programming for children with special needs. 

To help interagency groups conduct a process evaluation that monitors 
changes in agency linkage patterns, an Interorganizational Linkage Matrix 
(Bronheim, Cohen, and Magrab 1985) has been developed. (See Appendix B.) A 
useful approach for using the Interorganizational Linkage Matrix is the three- 
step process presented below. 

STEP 1 — Complete the Interorganizational Linkage Matrix based on what 
each agency perceives to be the ideal agency interactions and 
linkages for meeting interagency goals or specific objectives 
at the state or community level. 

STEP 2 — Complete the Interorganizational Linkage Matrix before 
embarking on an action plan. 

STEP 3 — Complete the Interorganizational Linkage Matrix at regular 
intervals as the action plan is implemented. 

Comparing the various results obtained from each of these three steps 

yields significant insight into the process and progress of the coordination 

effort. 

Measuring Dynamic Processes in Interagency Coordination 

The dynamic human element is perhaps the most intangible factor in an 
interagency coordination process, aiia is often ignored in developing a process 
evaluation strategy. However, if a process evaluation is to positively 
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influence an interagency coordination effort, then examining dynamic processes 
will likely be an important component of the evaluation effort. 

T'pically, an interagency group uses an introspective approach when 
examining decision-making and commun^' cation processes. This type cf self- 
examination can be threatening to a group, therefore it has been found to be a 
good idea to have a "neuttal" person not involved with the day-to-day work of 
the interagency team conduct this part -^f the evaluation. Maintaining the 
anonymity of individuals' responses increases the validity of such self- 
examinations • 

Several dimensions of interagency group interactions that can be included 
in a evaluation of group processes include: 

• Is effective leadership present i ^ the team? 

• Are communication and deci sion-ma*^.ing processes effective? 

• How well does the team manage conflict? 

• Is the team cohesi^'^? 

• Does team interaction provide support for accomplishing group tasks? 
9 Do external factors influence team function' ng? 

The responses to these questions may cit-ite the nucleus of a self-study that 

reveals the team'j ability to work together. The Organisation Dimensions 

Scale (Cohen, 1981) in Appendix C is a useful tool for monitoring the 

processes occurring in a state or ccmmiTiity interagency group. Where team 

subgroups exist, the scale can be used to monitor subgroup processes as 

well. A scale like Cohen's Organizational Dimensions Scale is recommended for 

administration on a routine basis; this prevents team members from viewing 

sui b evaluation as a response to a problem or a crisis. The information 

obtained from these procedures can diagnose problems with group dynamics. As 

a result, further group action, consultation ^ind/or c: ange may be required. 
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Examining the State-Community Partnership 

The previous discussions of process evaluation have stressed that 
interagency groups must monitor their own processes and activities in order to 
gauge the effectiveness of their coordination efforts—efforts which should, 
ultimately, create positive changes in service delivery to young handicapped 
children and their families. 

However, one should note that service delivery systems for these 
youngsters are also affected by che type of relationships existing between 
state-level interagency groups and local-level interagency groups. To assess 
the quality and strength of these state-community links and their affect on 
service delivery systems, groups conducting an interagency process evaluation 
may wish to include a component that would monitor these state-community 
relationships. 

Some of the process evaluation strategies discussed earlier can be 
adapted to assess this relationship. For example, items from the Interunit 
Relationships Scale can be completed by a state interagency group and the 
local group to assess factors such as interdependence, leader-^hip and central 
control, interunit communication, interunit work and resource flow, interunit 
communication, and perceived value of relationships. Additional areas for 
assessment might include the degree to which the state and local unit share 
the same philosophy of service delivery, the degree Lo which the state-level 
counterpart facilitates the work of the community, ^nd the extent to which the 
community ic responsive to statewide regionalized service expansion. 
Questions may be generated on whether the state has provided needed technical 
assistance, training, and policy leadership tuat facilitate collaborative and 
comprehensive services* 
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S ummary 

In this section, several procedures which can be used to monitor the 
progress of an interagency group were described. In summary, they include: 

(1) examining existing conditions and relationships that influence the 
work of the interagency group, 

(2) examining changes in linkage patterns among agencies involved in the 
coordination effort; and 

(3) examining the dynamics and decision-making processes of the 
interagency giToup to improve group interactions. 

In effect, process evaluation entails ^ series of baseline measures and 

periodic monitoring of several aspects of the interagency process. Implicit 

in process evaluation is the notion that the results will be used to guide and 

improve the continued work of che interagency group. 
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To achieve meaningful child- and family-oriented outcomes, interagency 
groups at state and local levels must function effectively and efficiently. 
Therefore, factors that affect group functioning must be monitored and 
assessed. Process evaluation, if done correctly, is a means for achieving 
this type of assessment—assessment which is critical to interagency success. 

la this document, we have attempted to provide a sound structure for 
interagency personnel who are conceptualizing and planning process evaluation 
strategies. In summary, persons attempting to set up pro-ess evaluation of 
interagency coordination should: 

(1) Determine or clarify the definition of coordination. On what level 
is collaboration being attempted? 

(2) Determine or clarifying the purpose(s) for the coordination. What 
are the reasons for coordination? What will each agency receive from 
the effort? 

(3) Determine the existing relationships among agencies; decide what 
relationships should ideally exist. Which linkages will be important 
to your goals for coordination? 

(4) Assess the quality and nature of the interagency group processes. 
How well are the agencies and the personnel within them working 
together? 

To help answer these questions, this paper has described several 
instruments and includes three particularly relevant measures as examples. 
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Because interagency efforts vary tremendously from state to state, however, 
personnel involved in planning an interagency evaluation should remember thac 
existing instruments may not always be appropriate for their needs, 
Inscruraents or items from instruments should be carefully examined to 
determine whether they need to be adapted to better suit each unique context. 

This document also includes summaries of selected state and local 
interagency coordination evaluation studies (see Appendix D) • The studies 
reflect a range of evaluation approaches, results, and recommendations. They 
should provide further stimulation to those planning an evaluation of 
interagency coordination. 
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Appendix A 
The Interunit Relationship Scale 
(Bronheim, Cohen, & Magrab, 1985) 



For information on how to use, score, and interpret the results from this 
scale, '..ontact: 

Phyllis Magrab 
The Network Project 
Georgetown University 
Child Development Center 
3800 Reservoir Road, N.W. 
Washington, D.C. 20007 
(202) 625-7033 
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INTEHUHIT REUTIOWSHIPS SCALE* 



I^L^n °" ^"^^""l" ^° *»scrlbe the relationships of your wrk unit (organization) to other work units (orqan Izatlons) 

engaged In planning, management, or service delivery for children with special needs. Identify the units (aqe^ es or^ld" arouos 
Tu^ t^^ns^'br'nilln* n'?he" u^blr T""'' relationship with - give each unlt'a number/ For each rita'^^o ship an Jer e'ach' ' 

questions by II I ng In the number of your response In the column corresponding to the appropriate orqanlzatlon Where sdpcI fled use 

^ I^Jt 2 Unit 3 Unit 4 Unit 5 Unit 6 

U Oonln s\m\ larlty 

In relation to the other unit, to •;fhat extent does your 
organizational unit: (use scale below) 

a. do the same kind of work (provide the same services)? 3a 

b. serve the same client population? 3t) 

c. serve the same geographic area? 3c 

Little Some Considerable Very great 

extent extent extent extent extent 

^ 2 3 4 5 



2. Task specialization 

In relation to the other unit, to what extent does your 
or nan tzat tonal unit: (use scale above) 

a, have similar operating goals? 4a 

b, have personnel with similar training? 4b 

c, use the same Information, equipment, or technology? 4c 

3. Intardapendanca 

a. For the other unit to accomplish Its goals and 
responsibilities how much does It need services, 
resources or support from your unit? 

Not at Very Soma Quite Very 

»V ^Jttle a bit much 

1 2 3 4 5 

b. For your unit to accomplish Its goals and respon- 
sibilities how much do you need services, resources, 

resources, or support from the other unit? (use ^ 
scale above) ^ 

ERJC 38 39 



Unit 1 



4. LMdershIp and central control 

8. To wh8t e)cten1 does your unit look to the other 
unit for leadership on definition of objectives, 
plans, or nv .^ds for your work? 6a 

b. is there an agency, committee, council, or con- 
sortium that governs relations between your unit 

and the other unit? 6t) 

No committee Coordinating Two-organU Multl-or- 

or agency agency ration com- ganlzatlon 

mittee committee 
0 12 3 

c. To what extent do decisions of Interorganlzatlonal 
agencies or committees bind your unit and the other 

unit. 6c 

'''o Little '}or^ Considerable Very great 

extent extent extent extent extent 

1 2 3 4 5 

3. FcMvllzatlon and standardization of relations 

a. To what extent have the terms of the relation- 
ship between your organ! 'jitlona* unit and the 
other unit: 

1» been explicitly dl'-cussed ana detailed? 78 1 

2. been written In contracts or affiliation 
agreements? 78^ 

3. been mandated bv law or regulation? 7a3 

b. In what extent are Interactions be'^'ween your 
unit and the other unit governed by sta-::*arH 
operating procedures (e.g., rules, pollcif 
guidelines, ♦orms, formal communlcatton 

channels)? (use scale above) 7t) 

6. Interunit co^wn leaf Ion 

a. During the past four months how frequently 
have be^n In contact with the other unit: 

1. through written letters, memos, o»' reports? 8a t 

2. through personal conversations? Sa2 
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Unit I 



3, through committee meetings with 3 or more 
people from your organization, from the 
other unit or from outside organizations? 8a3 

hbt once 1-2 Monthly Twice Weekly Several 
times monthly times a 

0 1 2 3 4 5 

b. In general what percent o. contacts were Initiated: 

1. by you or people In your organization? 8bl 

2. by people In the other unit? 3^2 

3. by people outside both organizations? 8b3 

7. ;nterunlt coi^Mtitlon 

To what extent does your unit compete with this 
other unit for: 



a. clients? 

b« funding? 

c. staff? 

d. leadership on policy direction or standard setting? 



9a 

9b 
9c 
9d 



To no Jttle Soma Considerable Very great 

extent extent extent extent extent 

'2 3 4 5 



8. Interim It work flow and r«soiirc« flow 

a. To what extent did the other unit receive each of 
the following resources from Its relationship with 
your unit during the past four months? (use scale 
above) 

1. Money or property (e.g., supplies, equipment) 

2. CI lent referra Is 

3. Consultation or technical assistance 



9. In what extent did your unit receive resources from the 
other unit during the past four months? 

I. Money or property (e.g., supplies, equipment) lObl 




lOal 
I0a2 
I0a3 



Unit 2 Unit 3 Unit 4 unit 5 Unit 5 




Unit t 



2. Client referrals 

3. Consultation or iechnlcal assistance 



To no 
extent 
1 



Little 
extent 

2 



Some 
extent 
3 



Considerable 
extent 
4 



c. During the past four months how often have you 
encountered exceptions to the normal flow of 
work resources, or services received from or 
sent to this other unit? (use scale In d below) 

d. During the past four montns how often did delays 
or other problems arise »n sending or receiving 
work, resojrces, or services to or from this 
other unit? 



tOb2 

I0b3 

Very great 
extent 

5 



10c 



Not once 
0 



1-2 Monthly Twice 
times monthly 



t.'eek I y 
4 



Severe I 
times a 
week 

5 



tOd 



10. IntvriMlt mmretmss 

a. How many years has your unit been Involved In 
some fashion with tMs other unit? 

b. How well Informed are you about the specific 
goals and services of the other unit? 



Not at 
al I 
1 



Little 
I nformed 
2 



Somewhat 
Informed 
3 



Quite 
Informed 
4 



11a 



lib 



Very we 1 1 
I nformed 
5 



1 } . Mmrm It consensus 

How much does your unit agree or disagree with the 
other unit on; 

a, the way work Is organized and performed In the 
service system 

b. the specific terms of relations between units? 



Disagree 
very much 
1 



Agree a 
little 
2 



Agree 
somewhat 
3 



Agree quite 
a bit 
4 



12a 

12b 

Agree vi ry 
mucn 
5 
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12. Quality of Interunit Interaction 



a. Overall how much difficulty do you experience In 
gettl/ig Ideas across clearly In conmunlcatlons 
to Individuals In this other unit? 

Ho contact None Little Some Quite a Very much 

bit 

0 12 3 4 5 

b. When you want communicate with Individual In 

the other unit how much difficulty do you have In 

getting In touch with them? (use scale above) I3b 

c. In what extent have Individuals In this other unit 
hindered your unit In performing Its functions during 

the past four months? 13c 

Little Some Considerable Very great 

extent extent extent extent extent 

« 2 3 4 5 



i3. Mutual Inf l«i«nctt and acooHBOdatlon 



a. How much Influence or say over the Internal policies 

and opera Hons of your unit does this other unit have? Ma 

>ne Little Soto Quite a bit Very much 

1 2 3 4 5 

b. How much Influence or say over the Internal policies 
and operations of the other unit does your unit 

have? (use scale above) I4t) 

c. During the past four months how often were there 
disagreements or disputes between people In your 

unit and this other unit? j4C 



Not once 1-2 About Twice About Several 

times monthly monthly weekly times a 

week 

0 12 3 4 5 

d. How well are any differences worked out at this time 

between you unit and this other unit? ]4d 

Very Poorly Poorly Adequately Mel I Very well 

12 3 4 5 



14* Perceived valua of ralatlonshlps 

Q- To whJt extant has this other unit carried out 
FRir responslbllltlas and commltmants In ralatlons 

your unit during the past tavaral montht* t9a 



Unft I 



Mnlt 2 



Unit 3 



Unit 4 



Unit 5 



Unit 6 



ba To what extent Is the t'me and effort spent In 
developing and maintaining the relationship with 
this other unit worthwhile? 

c. Overall to what extent are you satisfied with the 
relationship between your unit and this other unit? 



To no 
extent 



Little 
extent 

2 



Soine 
extent 

3 



Considerable 
extent 
4 



Very great 
extent 
5 




ng and Assessing Organizations ^ Ander H. Van 
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Appendix B 
The Interorganizational Linkage Matrix 
(Bronheira, Cohen, & Magrab, 1985) 



For information on how to use, score, and interpret the results from this 
scale, contact: 

Phyllis Magrab 
The Network Project 
Georgetown University 
Child Development Center 
3800 Reservoir Road, N.W, 
Washington, D,C, 20007 
(202) 625-7033 
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INTER0RGANI2ATI0NAL LINKAGE MATRIX 



Using the same Unit numbering system as you used for the Interunit Relation- 
ship Scale, complete the matrix. In each box enter letters for all charac- 
teristics present for the relationship from the unit named in the row to the 
unit named in the column (A-G). Circle any that represent significant prob- 
lems. Then develop a second matrix that represents the ideal picture of your 
community. You can then complete the matrix at regular intervals. 



A = INFORMATION EXCHANGE ONLY (communication, staff contact) 
B = RESOURCE EXCHANGE (funds, services, contracts) 
C = REFERRAL OF CLIENTS 

D = OVERLAPPING STAFF (joint appointments) 

E = JOINT ACTIVITIES 

F = JOINT PLANNING AND POLICY 

G = FORMALIZED AFFILIATION RELATIONS 



UNITS 



Relations From: 



Relations to: 
2 3 



4 



Unit I 



Unit 2 



Unit 3 



Unit 4 



Unit 5 



ERIC 



51 



51 



Appendix C 
The Organizational Dimensions Scale 
(Cohen, 1981) 



For inforaation on how to use, score, and interpret the results from this 
scale, contact: 

Phyllis Magrab 
The Network Project 
Georgetown University 
Child Development Center 
3800 Reservoir Road, N.W. 
Washington, D.C. 20007 
(202) 625-7033 
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ORGANIZATION DIMENSIONS SCALE 

Please circle the number which most nearly describes how you view the 
functioning of the community team on ths following dimensions. Also, please 
mark with an X how you viewed the functioning of the community team on each 

dimension on (date) (select a date that ic close to the beginning of 

your effort or to the last time you completed this scale). 

Goals 



1- clear 1 2 3 4 5 6 7 

2, conflicting among groups 12 3 4 5 6 7 

3, members indifferent 12 3 4 5 6 7 

4, supported by organiza- 12 3 4 5 6 7 
tional procedures 



confused 

shared among groups 

members feel involved 

not supported by 

organizational 

procedures 



Leadership Style 

5. autocratic 

6. oriented toward task 

7. seeks change 



1 2 3 4 5 6 7 
1 2 3 4 5 6 7 
1 2 3 4 5 6 7 



democratic 

oriented toward people 
maintains status quo 



Coordination and Interdisciplinary Function 



10, 



11. 



knowledge of other 
professionals and 
agencies is low 

task responsibility 
in the hands of one 
or a few 

tasks are fragmented 
among subgroups 

responsibilities .^re 
overlapping among 
professional disciplines 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 J 4 5 6 7 



knowledge of other 
professionals and 
agencies is high 

task responsibility 
shared by staff 



tasks are well coor- 
dinated among subgroups 

responsibilities are 
sharply differentiated 
among professional 
disciplines 
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Decision Making and Procedure s 

12. communication proce- 12 3 4 5 6 7 
dures are confused or 
unknown 
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communication proce- 
dures are nearly 
understood 
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13, decisions are made by 
part of tean; others* 
idess and opinions 
are not heard 

14, problems ar t not 
diagno*?ed well 

15, procedures to manage 
conflict are clevir and 
understood 

16- differences ar^ denied, 
w* ppresaeJ or avoided 



17, the team is closed; 
new members are 
ignored by the team 



18. the team handles mobt 
tasks by r'>utine 
procedures 



1 2 3 4 5 6 7 



5 6 7 



1 2 3 4 5 6 7 



2 3 4 



1 2 3 4 5 



1 2 3 4 5 



6 7 



decisions are ma^ by 
coni^ensus ; devi aa*- 
inf ormat ior. is used co 
improve doc i s ions 

problems are accurately 
diagnosed 

conflict management 
procedures are unknown 
or confused 

differences <_ recog- 
recognized, confronted, 
and worked through 

the team is open ; new 
memborr are oriented 
quick!' into group 
activiwiCS 

the team is f lexib le 
and seeks new and better 
ways to work 



Cohesivenes?^ and Trust 

19, team members rarely 
work closely 

20, I ieel very much a 
part of the team 



21 r consumers are well 
i 'tegrated into the 
team 



1 2 3 4 5 6 7 



3 4 5 6 7 



team members always 
work closely Logecher 

I feel outside the 
group; not really a part 
of the team 

consumers remain outside 
the team effort 



22, interactions among 
the team arc open 



3 4 5 6 7 



23. reelings are not freely 12 3 4 5 6 7 
expressed as part of 
team interaction 



interactions among the 
team are careful and 
guarded 

feelings are freely 
expressed and receive 
empathic responses 



Outcomes 



24. team interaction often 1 
hampers task achievement 



2 3 4 5 6 7 



tear Interaction 
usually helps task 
achievement 
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2. • group meetings usually 
accomplish what is 
necessary 

26. all team member 

resources are used 
effectively by the 
group 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



group meetings usually 
do not accomplish 
what is necessary 

many team member 
resources and skills 
are not used by the 
group 



External Conditions 

27. regulatory require- 
ments have limited 
impact on the work 



1 2 3 4 5 6 7 



reimbursement require- 
ments place severe 
constrain ^ on the way 
work is GO e 



Adapted from Cohen, Perry D. _E valuation of Interdisciplinary Team Training 
and Humanistic Patient Care Trainin f > i n Hospices; Case Study- 
Demonstration Site #1 . Perry Cohen Associates, September 1981. 
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ORGANIZATION DIMENSIONS SCALE 
Scoring Summary Sheet 



Average Scale Scores 
Administration Administration Administration 

1 2 3 



Goals 1 

2 

3 
4 

Sub Average - 








Leadership 
Style 5 
6 
7 

Sub Average — 








Coordination 8 
& Interdis- 9 
ciplinary 10 
Function il 
Sub Average — 








Decision 12 
Making & 13 
Procedures 14 
15 
16 
17 

1 o 

Sub Average — 








Cohesiveness 19 
& Trust 20 
21 
22 
23 

Sub Average — 








Outcomes 24 
25 
26 

Sub Average — 








External 27 
Conditions 28 
Sub Average — 
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Appendix D 

Summaries of Selected State and Local Evaluation Studies 
of Service Coordination Projects 
by 

Cynthia Flynn 
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The following review of selected evaluation studies shows what is 
possible in evaluation, as well as the degree of success achieved through 
these evaluation studies, and whac impact chese studies may have on future 
studies. This material is not an exhaustive review of all existing studies? 
rather, it represents a selection of studies most relevant to this monograph. 

Local-Level Evaluation 

Tlie majority of studies that have been done focuses on local-level 
efforts. One of the most famous of these, a study by Gana ind Horton (1975), 
explored 30 local-level projects involved in interagency coordination. The 
absence of data precluded rigorous quantitative measures of efficiency or cost 
effectiveness. The study was an outcome evaluation requested by the federal 
government to recommend changes (needed at the federal level) for facilitating 
local coordinated service delivery. Cans and Horton (1975) fcun'i that there 
is no one best services integration model that every community should 
follow. They recommended the federal government take steps to facilitate and 
shape interagency coordination efforts by creating an environment that: 
includes funding policies receptive to coordination, provides technical 

er|c 
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assistance to overcome the general lack of knowledge, monitors interagency 
efforts, and eliminates barriers to effective coordination. 

In another study, Flarety, Barry, and Swift (1978J used an unobtrusive 
measure to evaluate the development of interagency coordination generated by 
an early prevention project. This outcome evaluation, done while the project 
W25 operating, examined agency coordination efforts retrospectively. They 
examined the project's existing records, including a central file maintained 
by the director's auministrative assistant and the files of two secretaries. 
Contact with other agencies, records of meetings, and additional records 
documenting communication between agencies ^ere used. Staff were also 
interviewed to c^'^rify questions and problems concerning record keeping and to 
determine what records were missing. 

Flarety et al (1978) used a quantitative method of data analysis to show 
the extent and form of interagency contacts, which staff were involved, and 
the content of the contacts. The information they collected was used to 
examine three areas of concern. First, they looked at the types of agencies 
that were contacted. Schools and child care agencies were found to be the 
most frequently contacted groups. The second concern was the level of staff 
involved. Existing records did not provide enough information to adequately 
answer these questions. From the limited information available, it appeared 
that the staff involved were outreach workers and suporvisors. The third and 
final area of concern focused on the content of the interagency contacts. 
Most contacts were "information giving," followed by discussions of service 
provision, linkage initiation, and program development. 

Van de Ven, Walker, and Liston (1979) examined and compared coordination 
patterns amc ? clusters of organizations; all of these organizations belonged 
to a larger network of human service agencies. Van de Ven et al (1979) 
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evaluated the reasons for coordination given by the other organizations. They 
focused on patterns of relationships in an identifiable population of agencies 
bound together by geography, allied domains, target client populations, etc. 
(Van de Ven et al, 1979). A survey was distributed to 21 local agencies 
asking them to identify the five agencies with whom they had the most direct 
involvemenr in the preceeding six months. A quantitative method of analysis 
was used to look at the number of times agencies were chosen and the 
similarity of choices made by responding agencies. Specifically, a block 
modeling computer algorithm called CONCOR was used to identify nine blocks of 
agencies. Of these, three tightly connected clusters were identified; each 
was found to exist for a different reason. 

They also found that significantly different patterns of interagency 
relationships existed between the clusters. The resource transactions cluster 
wis characterized as having a formal procedure for accountability and an 
impersonal style of interaction. The planning and coordination cluster 
reported the lowest dependence and highest awareness and consensus. They 
established formal, legitimate ways of contacting one another, but not for a 
legal or mandatory agreement (Van de Ven et al, 1979). The last cluster, 
direct services, reported the least formal procedures for contacting one 
another. Van de Ven et al (1979) concludei, as a result of this study, that 
"it is important to determine the different reasons for interorganizational 
relationships if one is to understand the various patterns of coordination 
among clusters of organizations within interorganizational networks" (p. 19). 

State-Level Evaluation 

Few evaluation studies have been conducted at the state level. Because 
many of the existing studir 3xamine the Florida reorganization effort, the 
studies reviewed for this paper are those that focus on Florida. Lynn (1976) 
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did an in-depth analysis of the Florida reorganization, developing a framework 
for analysis that is designed as a first step for predicting how states will 
deal with human service organizations. He used a pluralistic frame of 
reference to exa ne the roles and interrelationships of the governor, the 
legislature, and the mental health community. 

In conducting his study, Lynn (1976) did not follow the typical 
scientific model of hypothesis, pretest, intervention, and post-test. Rather, 
the study was an in-depth analysis that examined the events leading up to the 
Florida State Legislature's reorganization of the Department of Health and 
Rehabilitative Services. Lynn (1976) raised some important questions. The 
most important question was; If states acquire greater autonomy, what types 
of human service organizations can be expected, over time, to emerge? 

This question, of course, led to other inquiries. Although Lynn's 
methods of inquiry were not detailed specifically, he appears to have 
interviewed all persons involved, collected information on the organizations 
involved, and analyzed specific legislation. This type of in-depth analysis 
was needed because of the multifaceted nature of reorganization at that level 
of state government. Lynn's summary comments did not refer to methodological 
successes or failures. Instead, he focused on what could be learned from the 
Florida experience and on specific recommendations for Florida. His comments 
are not easily summarized md are best understood by reading the entire 
article. 

Frumkin, Imershein, Chackerian, and Martin (1983) examined state-level 
coordination in Florida from a different perspective. They did not focus on 
the political context; instead, they theorized that it was more practical to 
study "the day-to-day activities and decisions that take place within specific 
organizational structures" (Frumkin et al, 1983, p. 19). 



ERIC 



6: 



67 



Frumkin et al (1983) found that most evaluation studies fall short of 
adequately assessing the promise of services integration because they: (1) 
examine the "what," not the "why," (2) were not sufficiently inclusive to 
evaluate multiple levels of functioning and their interrelationships, and (3) 
used data drawn from existing organizational documents or informant interviews 
(Frumkin et al, 1983). They describe a new methodology (still in development 
stages) that is based on the assumption that stated goals cannot form the 
basis for evaluating the promise of an integrated system. Goal-setting is a 
political process, and a different set of behaviors are often implemented. 

Their research instruments, therefore, are grounded in actual 
observations, while their evaluation focuses on the ability to match client 
needs with organizational solutions (Frumkin et al, 1983). The new process 
involves two steps: 

(1) Collecting information about problems and about the actual structure 
and functions. This information is collected at both the client and 
the agency level. 

(2) Determining effectiveness and efficiency. There are two ways to 
collect this information. One is comparative — holding the client 
constant and coaparing the ability of one human service agency with 
an alternative structure. The second is normative — where an ideal 
is created and actual solutions or matches compared to it. Evidence 
of success using this model has not yet been published. 

Potential Models for Evaluation 

McLaughlin and Covert (1984) developed a method ifor evaluating 
interagency collaboration that can be used at either state or local levels. 
They stressed the need for an ongoing e^'aluation, rather than one which looks 
at what has already 'occurred; further, they focused on the intent of the 
collaborative programs. This method of evaluation could be adapted for use as 
a process or an outcome evaluation. 

Flynn (1984) analyzed local interagency coordination effort? by examining 
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the reasons for coordination, the strategies employed, and the final 
outcomes. Although not designed as an evaluation study, it could be adapted 
for use as a combination process and outcome evaluation study. 

Members of local interagency groups were interviewed using a standard 
interview format. The information was analyzed using qualitative Analysis of 
Variance. 

The analysis revealed 11 reasons for coordination; these were categorized 

under tour headings: coercion, frustration, idealism, «nd attraction. 

Reasons for oordination varied in each community. This resulted in the use 

of different implementation strategies and outcomes. The strategies and 

outcomes werp grouped into five classes; leadership, form, process, saliency, 

and scope. Three models of interagency coordination were formed based on 

these sets of reasons, st^'ategies, and outcomes: 

o The first model represents voluntary coordination formed through 
belief in coordination and frustration with the system. This model 
is characterized by low process, scope, and saliency, with high form 
and leadership. 

o The second model represents coordination developed through negative 
coercion. For example, most members join to protect their 
respective turfs. This model exhibits strong leadership; it is low 
in form and scope, but is high in process and saliency. 

o In the third modeli coordination is based on positive coercion and 
belief in coordination. Most members were idealistic about 
coordination, frustrated by the system, and attracted through 
invitation. It is characterized by strong leadership, high scope and 
form, with low process and saliency. 
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